Retrospective Reader for Machine Reading Comprehension

Machine reading comprehension (MRC) is an AI challenge that requires machine to determine the correct answers to questions based on a given passage. MRC systems must not only answer question when necessary but also distinguish when no answer is available according to the given passage and then tactfully abstain from answering. When unanswerable questions are involved in the MRC task, an essential verification module called verifier is especially required in addition to the encoder, though the latest practice on MRC modeling still most benefits from adopting well pre-trained language models as the encoder block by only focusing on the "reading". This paper devotes itself to exploring better verifier design for the MRC task with unanswerable questions. Inspired by how humans solve reading comprehension questions, we proposed a retrospective reader (Retro-Reader) that integrates two stages of reading and verification strategies: 1) sketchy reading that briefly investigates the overall interactions of passage and question, and yield an initial judgment; 2) intensive reading that verifies the answer and gives the final prediction. The proposed reader is evaluated on two benchmark MRC challenge datasets SQuAD2.0 and NewsQA, achieving new state-of-the-art results. Significance tests show that our model is significantly better than the strong ELECTRA and ALBERT baselines. A series of analysis is also conducted to interpret the effectiveness of the proposed reader.Comment: Accepted by AAAI 202

Explanation of the ATLAS Z-peaked excess by squark pair production in the NMSSM

The ATLAS collaboration recently reported a $3\sigma$ excess in the leptonic-$Z+jets+E_{T}^{miss}$ channel. We intend to interpret this excess by squark pair production in the Next-to-Minimal Supersymmetric Standard Model (NMSSM). The decay chain we employ is $\tilde{q} \to q \tilde{\chi}_2^0 \to q \tilde{\chi}_1^0 Z$, where $\tilde{\chi}_1^0$ and $\tilde{\chi}_2^0$ denote the lightest and the next-to-lightest neutralinos with singlino and bino as their dominant components respectively. Our simulations indicate that after considering the constraints from the ATLAS searches for $jets + E_{T}^{miss}$ signal the central value of the excess can be obtained for $m_{\tilde{q}} \lesssim 1.2 {\rm TeV}$, and if the constraint from the CMS on-$Z$ search is further considered, more than 10 signal events are still attainable for $m_{\tilde{q}} \lesssim 750 {\rm GeV}$. Compared with the interpretation by gluino pair production, the squark explanation allows for a significantly wider range of $m_{\tilde{q}}$ as well as a less compressed SUSY mass spectrum. We also show that the squark explanation will be readily tested at the initial stage of the 14 TeV LHC.Comment: 19 pages, 4 figure

Explanation of the ATLAS Z-peaked excess in the NMSSM

Recently the ATLAS collaboration reported a $3\sigma$ excess in the leptonic-$Z+jets+E_{T}^{miss}$ channel. This may be interpreted in the Next-to-Minimal Supersymmetric Standard Model (NMSSM) by gluino pair production with the decay chain $\tilde{g} \to q \bar{q} \tilde{\chi}_2^0 \to q \bar{q} Z \tilde{\chi}_1^0$, where $\tilde{\chi}_1^0$ and $\tilde{\chi}_2^0$ denote the lightest and the next-to-lightest neutralinos with singlino and bino as their dominant components respectively. After exploring the relevant parameter space of the NMSSM by considering the constraints from the ATLAS searches for $jets + E_{T}^{miss}$ signals, we conclude that the NMSSM is able to explain the excess at $1 \sigma$ level with the number of the signal events reaching its measured central value in optimal cases, and the best explanation comes from a compressed spectrum such as $m_{\tilde{g}} \simeq 650 {\rm GeV}$, $m_{\tilde{\chi}_2^0} \simeq 565 {\rm GeV}$ and $m_{\tilde{\chi}_1^0} \simeq 465 {\rm GeV}$. We also check the consistency of the ATLAS results with the null result of the CMS on-$Z$ search. We find that under the CMS limits at $95\%$ C.L., the event number of the ATLAS on-$Z$ signal can still reach 11 in our scenario, which is about $1.2 \sigma$ away from the measured central value.Comment: 18 pages, 2 figure